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NORMALIZED GRAPH LAPLACIANS FOR DIRECTED 

GRAPHS 

FRANK BAUER 



Abstract. We consider the normalized Laplace operator for di- 
rected graphs with positive and negative edge weights. This gener- 
alization of the normalized Laplace operator for undirected graphs 
is used to characterize directed acyclic graphs. Moreover, we iden- 

£/-) ' tify certain structural properties of the underlying graph with ex- 

tremal eigenvalues of the normalized Laplace operator. We prove 
comparison theorems that establish a relationship between the 
eigenvalues of directed graphs and certain undirected graphs. This 

\mJ ' relationship is used to derive eigenvalue estimates for directed 

C"| ■ graphs. Finally we introduce the concept of neighborhood graphs 

for directed graphs and use it to obtain further eigenvalue esti- 
mates. 
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1. Introduction 

For undirected graphs with nonnegative weights, the normalized 
graph Laplace operator A is a well studied object, see e. g. the mono- 
graph jHJ. In addition to its mathematical importance, the spectrum of 
the normalized Laplace operator has various applications in chemistry 
and physics. However, it is not always sufficient to study the normal- 
ized Laplace operator for undirected graphs with nonnegative weights. 
In many biological applications, one naturally has to consider directed 
graphs with positive and negative weights J3J. For instance, in a neu- 
ronal network only the presynaptic neuron influences the postsynaptic 
one, but not vice versa. Furthermore, the synapses can be of inhibitory 
or excitatory type. Inhibitory and excitatory synapses enhance or sup- 
press, respectively, the activity of the postsynaptic neuron and thus 
the directionality of the synapses and the existence of excitatory and 
inhibitory synapses crucially influence the dynamics in neuronal net- 
works [3j. Hence, a realistic model of a neuronal network has to be a 
directed graph with positive and negative weights in which the neurons 
correspond to the vertices and the excitatory and inhibitory synaptic 
connections are modelled by directed edges with positive and negative 
weights, respectively. 

In contrast to undirected graphs not much is known about normal- 
ized Laplace operators for directed graphs. In [9] Chung studied a 
normalized Laplace operator for strongly connected directed graphs 
with nonnegative weights. This Laplace operator is defined as a self- 
adjoint operator using the transition probability operator and the Per- 
ron vectoio. For our purposes, however, this definition of the normal- 
ized Laplace operator is not suitable since by the above considerations 
we are particularly interested in graphs that are neither strongly con- 
nected nor have nonnegative weights. In this article, we define a novel 
normalized Laplace operator that can in particular be defined for di- 
rected graphs that are neither strongly connected nor have nonnega- 
tive weights. In contrast to Chung's normalized Laplace operator our 
normalized Laplace operator is in general neither self-adjoint nor non- 
negative. Moreover, our definition of the normalized Laplace operator 
is motivated by the observation that it has already found applications 
in the field of complex networks, see 0, |3J. 

The paper is organized as follows. In Section 2 we define the normal- 
ized Laplace operator for directed graphs and in Section 3 and Section 
4 we derive its basic spectral properties. In Section 5 we characterize 



*A similar construction is used in |25j to study the algebraic connectivity of the 
Laplace operator L = D — W defined on directed graphs. 
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directed acyclic graphs by means of their spectrum. Extremal eigen- 
values of the Laplace operator are studied in Section 6 and Section 7. 
In Section 8 we prove several eigenvalues estimates for the normalized 
Laplace operator. Finally in Section 9 we introduce the concept of 
neighborhood graphs and use it to derive further eigenvalue estimates. 

2. Preliminaries 

Unless stated otherwise, we consider finite simple loopless graphs. 
Let T = (V, E, w) be a weighted directed graph on n vertices where V 
denotes the vertex set, E denotes the edge set, and w : V x V — > R 
is the associated weight function of the graph. For a directed edge 
e = (i,j) € E, we say that there is an edge from i to j. The weight 
of e = (i,j) is given by Wji u and we use the convention that Wji = 
if and only if e = (i,j) ^ E. The graph T = (V, E, w) is an undirected 
weighted graph if the associated weight function w is symmetric, i.e. 
satisfies Wij = w^ for all i and j. Furthermore, T is a graph with non- 
negative weights if the associated weight function w satisfies w^ > 
for all % and j. For ease of notation, let G denote the class of weighted 
directed graphs I\ Furthermore, let G n , G + and G u+ denote the class of 
weighted undirected graphs, the class of weighted directed graphs with 
non-negative weights and the class of weighted undirected graphs with 
non-negative weights, respectively. The in-degree and the out-degree 
of vertex i are given by d™ := V • w^ and d° ut := V . Wji, respectively. 
A graph is said to be balanced if df 1 = d° ut for all % G V. Since every 
undirected graph is balanced, the two notions coincide for undirected 
graphs. Thus, we simply refer to the degree di of an undirected graph. 
A graph T is said to have a spanning tree if there exists a vertex from 
which all other vertices can be reached following directed edges. A 
directed graph Y is weakly connected if replacing all of its directed 
edges with undirected edges produces a connected (undirected) graph. 
A directed graph V is strongly connected if for any pair of distinct 
vertices i and j there exists a path from i to j and a path from j to 
i. An undirected graph is weakly connected if and only if it is strongly 
connected. Hence, we do not distinguish between weakly and strongly 
connected undirected graphs. We simply say that the undirected graph 
is connected if it is weakly (strongly) connected. 

Definition 2.1. Let C(V) denote the space of complex valued func- 
tions on V. The normalized graph Laplace operator for directed graphs 



^We use this convention instead of denoting the weight of the edge e = (i,j) 
by Wij, since it is more appropriate if one studies dynamical systems defined on 
graphs, see for example [2]- 
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r G G is defined as 

A : C(V) -> C(V), 

(i) A v(ji) = { v ®-wX i «tf>U) if^^o. 

U "la" . 

If d™ j^ for all i & V, then A is given by 

A = I - D~ X W, 
where D : C(V) — > C(V) is the multiplication operator defined by 
(2) Dv(i) = dfvii) 

and W : C(V) — > C(V) is the weighted adjacency operator 

Wv(i) = ^2iVijv(j). 
jev 

When restricted to undirected graphs with nonnegative weights, Defini- 
tion [ID] reduces to the well-known definition of the normalized Laplace 
operator for undirected graphs with nonnegative weights, c.f.[19j. 

The choice of normalizing by the in-degree is to some extend arbi- 
trary. One could also consider the operator 

A:C{V) -*C{V), 



(3) Av(i) =r- > 



else. 

Note however, that both operators A and A are equivalent to each 
other in the sense that A(T) = A(T), where T is the graph that is 
obtained from T by reversing all edges. 

Since we consider a normalized graph Laplace operator, i. e. we nor- 
malize the edge weights w.r.t. the in-degree, vertices with zero in- 
degree are of particular interest and need a special treatment. We 
define the following: 

Definition 2.2. We say that vertex % is in-isolated or simply isolated if 
Wij = for all j G V. Similarly, vertex % is said to be in-quasi-isolated 
or simply quasi-isolated if df 1 = V . ib^ = 0. 

Note that every isolated vertex is quasi-isolated but not vice versa. 
These definitions can be extended to induced subgraphs: 

Definition 2.3. Let T = (V, E, w) G G be a graph and V = (V, E', w') 
be an induced subgraph of T, i.e. V C V, E' = E n (V x V) C E, 
and w' : V X V — >• R, w' := w\e'- We say that T' is isolated if ^ = 
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for all i G V' and j <£ V' . Similarly, V is said to be quasi-isolated if 
^2jev\v w ij = ° for a11 i G V> - 

We do not exclude the case where V = V. Thus, in particular, every 
graph T is isolated. 

It is useful to introduce the reduced Laplace operator A R . 

Definition 2.4. Let Vr C V be the subset of all vertices that are not 
quasi-isolated. The reduced Laplace operator A^ : C(Vr) — > C(Vr) is 
defined as 

(4) A r v(i) = v{t)- — J2^Aj) *eVk, 

' J£V R 

where df 1 is the in-degree of vertex i in T. 

As above Ar can be written in the form Ar = Ir — D^Wr where 
Ir is the identity operator on Vr. 

It is easy to see that the spectrum of A consists of the eigenvalues 
of A# and \V \ Vr\ times the eigenvalue 0, i. e. 

(5) spec (A) = (|V \ Vr\ times the eigenvalue 0) U spec(A^). 

We remark here that A# can be considered as a Dirichlet Laplace 
operator. The Dirichlet Laplace operator for directed graphs is defined 
as in the case of undirected graphs, see e. g. [16]. Let Q C V and 
denote by C(fi) the space of complex valued functions v : Q — > C. 
The Dirichlet Laplace operator Aq on C(Q) is defined as follows: First 
extend v to the whole of V by setting v — outside Q and then 

A u v = (Av)\n, 

i. e. for any % G fi we have 

Anv(z) = v(i) - -jfo^WiMj) = v(i) - -fr^Wijvij) 

since v(j) = for all j £ V \Q. Hence, A R = A^ if we set Q = Vr. 

As already mentioned in the introduction, we are particularly in- 
terested in graphs that are not strongly connected. However, every 
graph that is not strongly connected can uniquely be decomposed into 
its strongly connected components [6]. Using this decomposition, the 
Laplace operator A can be represented in the Frobenius normal form 
[6], i. e. either T is strongly connected or there exists an integer z > 1 
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S.t. 



(6) 



A 



/ Ax 




Ai 2 
A 2 



\ 



A l2 

A 2 , 

A z 



/ 



where Ai, . . . A z are square matrices corresponding to the strongly con- 
nected components r 1; . . . , T z of Y. In the following, the vertex set of 
Tfc is denoted by V&. Then the off-diagonal elements of A*, are of the 
form ^ for all i,j G V^ if df 1 7^ and zero otherwise and the di- 

agonal elements are either zero (if the in-degree of the corresponding 
vertex is equal to zero) or one (if the in-degree of the corresponding 
vertex is nonzero). If 14 does not contain a quasi-isolated vertex, then 
Afc is irreducible. Furthermore, the submatrices Ajy, 1 < k < I < z 
are determined by the connectivity structure between different strongly 
connected components. For example, Am contains all elements of the 
form ^- for all i G ^ and all j G V\. A simple consequence of ([6]) is 
that 



(7) 



spec(A) = Mspec(Aj). 



i=l 



Note that Aj, i — 1, . . . , z, is a matrix representation of the Dirichlet 
Laplace operator of the strongly connected component Tj , i.e. Aj = 
An for fl = Vi. To sum up our discussion, the spectrum of the Laplace 
operator of a directed graph is the union of the spectra of the Dirichlet 
Laplace operators of its strongly connected components Tj. 

We conclude this section by introducing the operator P :— I — A. 
We have 

P:C{V) ^C(V), 



Pv(i) 



i J 

else. 



■*3 

v(i) 



For technical reasons, it is sometimes convenient to study P instead of 
A. Clearly, the eigenvalues of A and P are related to each other by 



(9) 



A(A) = 1-A(P), 



i. e. if A is an eigenvalue of P then 1 — A is an eigenvalue of A. When 
restricted to graphs T G G + , P(T) is equal to the transition probability 
operator of the reversal graph T. Furthermore, we define the reduced 
operator P R = I R - A R 



D-fW. 



R- 
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3. Basic properties of the spectrum 

In this section, we collect basic spectral properties of the Laplace 
operator A. 

Proposition 3.1. Let Y G G then following assertions hold: 

(i) The Laplace operator A has always an eigenvalue A = and the 

corresponding eigenfunction is given by the constant function, 
(ii) The eigenvalues of A appear in complex conjugate pairs. 
(Hi) The eigenvalues of A satisfy 

n— 1 n— 1 

i=0 i=0 

(iv) The spectrum of A is invariant under multiplying all weights 

of the form Wij for some fixed i and j = 1, ..,n by a non-zero 

constant c. 
(v) The spectrum of A is invariant under multiplying all weights by 

a non-zero constant c. 
(vi) The Laplace operator spectrum of a graph is the union of the 

Laplace operator spectra of its weakly connected components. 

Proof. (i) This follows immediately from the definition of A since 

U clot;. 

(ii) Since A can be represented as a real matrix, the characteristic 
polynomial is given by 

det(A - XI) = a + «iA + ... + a^-iA™ -1 , 

with Oj G R for all i — 0, 1, . . . , n — 1. Consequently, det(A — 
XI) = if and only if det(A - XI) = 0. 

The equality 5^=0 -^ = X^=o ^(^«) follows from (ii). By con- 
sidering the trace of A, one obtains Y^7=o ^ = \Vr\- 



[in 



[iv), (v) and (vi) follow directly from the definition of A. 



□ 



From Proposition I3.1( i;) it follows that it is equivalent to study the 
spectrum of graphs with nonnegative or nonpositive weights. Moreover, 
because of Proposition 13. lt vi). we will restrict ourselves to weakly con- 
nected graphs in the following. 

Proposition 3.2. The spectrum of A satisfies 

spec(A) C V(l,n) U {0} C V(l,r 2 ) U {0} C V(l,r) U {0}, 
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where T>(c,r) denotes the disk in the complex plane centered at c with 
radius r and 



T\ := max max 

P =i,...,z iev R , p |d- n | 

^jeVi? \ w ij\ 
r 2 := max — J — r ^- l , 



i&v R \d» 



and 



(10) r := maxr(i), 

i€V 

where r(i) = — Ji rJ n| IJ . Here, Vr,i, . . . , Vr )Z are the strongly connected 
components of the induced subgraph Tr whose vertex set is given by Vr. 
We use the convention that ri,r 2 and r are equal to zero if df 1 = 0. 

Proof. Clearly, T\ < r 2 < r and the proof follows from Gersgorin's 
circle theorem (see e. g. [IB]) and (jSJ-dZD- D 

For undirected graphs with nonnegative weights Proposition 13.21 re- 
duces to the well-known result [8], that all eigenvalues of A are con- 
tained in the interval [0, 2]. 

The radius r in Proposition 13.21 has the following properties: r > 1 
if and only if Vr ^ and r = if and only if Vr = 0. 

Lemma 3.1. Let T be a graph without quasi-isolated vertices and let 
r(i) = r = 1 for all i G V . Then there exists a graph T + e G + that is 
isospectral to T. 

Proof. Since r = 1 it follows from the definition of r that for every 
vertex i & V the sign sgn(wjj) is the same for all j 6 V. By Proposition 
13.11 (iv) the graph T + G G + that is obtained from T by replacing the 
associated weight function w by its absolute value |io| is isospectral to 

r. □ 

In the following, r + is called the associated positive graph of I\ 
Corollary 3.1. For graphs T G G the nonzero eigenvalues satisfy 

(11) 1 - r < min ft(Ai) < ' ' < max 9£(A,) < 1 + r, 

J:A^0 n-m i:Xi^0 

where mo denotes the multiplicity of the eigenvalue zero. In particular, 
we have 

1 < max 9ft(Aj). 

Proof. This estimate follows from Proposition 13. II (Hi) and Proposition 
13.21 The last statement follows from the observation that n — m® < 

\V R \. D 
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Figure 1. For a graph r G G + with n vertices, all 
eigenvalues of A are contained in the shaded region. 



Later, in Corollary l7.4[ we characterize all graphs for which maxj.^o 3^(A^ 
1 + r. Similarly, in Corollary 17.71 we characterize all graphs for which 
minj :A .^ 9£(Aj) = 1 — r, provided that r > 1. 

For graphs with nonnegative weights, Proposition 13.21 can be further 
improved. 

Proposition 3.3. Let Y G G + , then all eigenvalues of the Laplace 
operator A are contained in the shaded region in Figure Q 



Proof. This follows from the results in 
sion. 



see [22] for further discus- 

□ 



We close this section by considering the following example. 

Example 1. In [8] it is shown that the smallest non-trivial eigen- 
value Ai of non-complete undirected graphs r G G u+ with nonnegative 
weights satisfies Ai < 1. It is tempting to conjecture that min^o 5R(A») < 
1 for all non-complete undirected graphs with positive and negative 
weights and for all non-complete directed graphs with nonnegative 
weights. However, the two examples in Figure [2] show that this is, 
in general, not true. For both, the non-complete graph l\ G G u in 
Figure |2] (a) and the non-complete graph T 2 G G + in Figure |2] (b) we 
have minj^ 9ft(Ai) > 1. Thus, there exist non-complete graphs Tx G G u 
and T 2 G G + for which the smallest non-zero real part of the eigenval- 
ues is larger than the smallest non-zero eigenvalue of all non-complete 
graphs T G G u+ . This observation has interesting consequences for the 
synchronization of coupled oscillators, see p. 



4. Spectrum of A and isolated components of T 
We have the following simple observation: 



10 
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3 ) . ,o b > 



1/2 1 





Figure 2. a) The eigenvalues of A are 1.45 ± 
0.46i,1.10,0. b) The eigenvalues of A are 1.65,1.18 ± 
0.86z',0. 



Lemma 4.1. Consider a graph r G G and let 1^,1 < i < r be its 
strongly connected components. Furthermore, let the Laplace operator 
A be represented in Frobenius normal form (G|). Then, 
(i) IfTi is isolated then Ajj = for all j > i. 

(ii) If Ti is quasi-isolated then the row sums of Aj^+i) . . . A ir add 
up to zero. 
Moreover, i/Te G + then 

(Hi) Ti is isolated if and only if Ay = for all j > i. 
(iv) Ti is quasi-isolated if and only if the row sums of Aj 
add up to zero. 



H,(i+1) ■ ■ ■ Aj r 



Lemma 4.2. Every graph T G G contains at least one isolated strongly 
connected component. Furthermore, T G G contains exactly one iso- 
lated strongly connected component if and only ifT contains a spanning 
tree. 

Proof. This follows immediately from the Frobenius normal form of 

A. □ 

In particular, every undirected graph r G G u is strongly connected 
and isolated. 

In general, it is not true that the spectrum of an induced subgraph 
T' of T is contained in the spectrum of the whole T, i. e. spec (A (T')) ^ 
spec (A (r)). However, we have the following result: 

Proposition 4.1. Let T G G and V be an induced subgraph ofT. If 
one of the following conditions is satisfied 

(i) r" consists of 1 < p < r strongly connected components of T 

and is quasi-isolated, 
(ii) r" is isolated, 
then 

spec(A(r')) C spec(A(r)). 
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Proof, (i) First, assume that T' is quasi-isolated and consists of p 
strongly connected components of T. Without loss of generality we 
assume that T' = Uf =1 IY Since T' is quasi-isolated we have for all 
vertices i G V: 

d T = E Wi * = E Wi i + E Wi i = E Wi i 
jev jev jev\v jev 

Thus, the in-degree of each vertex i G V' is not affected by the vertices 
in V \ V. Using §6§ and ([7]) we obtain 

p r 

spec(A(r')) = IJspec(Ai) C |Jspec(Aj) = spec(A(r)). 

i=l i=l 

(ii) Now assume that T' is isolated. Observe that each isolated in- 
duced subgraph V of T has to consist of p, 1 < p < r strongly con- 
nected components of T. Thus, the second assertion follows from the 
first one. □ 

We will make use of the following theorem by Taussky [23] . 

Theorem 4.1 (|23j)- A complex nxn matrix A is non-singular if A is 
irreducible and \Au\ > YIjm \Aij\ with equality in at most n — 1 cases. 

Lemma 4.3. Let V G G + be a graph with nonnegative weights and let 
Ti, 1 < i < r be its strongly connected components. Furthermore, let A 
be represented in Frobenius normal form. Then, zero is an eigenvalue 
(in fact a simple eigenvalue) of A.; if and only if Ti is isolated. 

Proof. We observe that since T G G + , it follows that d" 1 ^ for all 
j G Ti and hence Aj is irreducible. First assume that Tj is not isolated. 
Assume further that Tj consists of more than one vertex. Then there 
exists a vertex k G Vi s.t. wm ^ for some I ^ V^. For vertex k we 
have 

2^-evFfcjl jeVi \ a k\ jev . 
For all other j G Vi we have 



i(Ai)iii = i>Ep = Ei( A *w 



lav, ' i ' laVi 



and hence by Theorem 14.11 is not an eigenvalue of Aj. If Ti consists 
of one vertex, then 1 is the only eigenvalue of Aj and hence is not an 
eigenvalue of Aj. 

Now we assume that Tj is isolated and consists of more than one 
vertex. We consider the operator Pj := Jj — Aj, where /j is the identity 



12 FRANK BAUER 

operator on IV Since all row sums of P L are equal to one, it follows that 
the spectral radius p of P, is equal to one. Moreover, since V G G + , it 
follows that Pi is non-negative and irreducible. The Perron- Frobenius 
theorem implies that p = 1 is a simple eigenvalue of Pi and hence, by 
(Q, is a simple eigenvalue of Aj. If Tj is an isolated vertex, then 
clearly is a simple eigenvalue of Aj. □ 

Theorem 4.2. For a graph V G G + the following four statements are 
equivalent: 

(i) T/ie multiplicity rri\ (P) of the eigenvalue one of P is equal to 

k. 
(ii) The multiplicity mo (A) of the eigenvalue zero of the Laplace 

operator A is equal to k. 
(iii) There exist k isolated strongly connected components in T. 
(iv) The minimum number of directed trees needed to span the whole 

graph is equal to k. 

Proof, (i) <^> (ii) follows from (j5j). iii) <^> (iii) follows from Lemma 
14.31 and (171). (iii) <^> (iv) follows from the Frobenius normal form and 
Lemma [4. II (iii). □ 



A similar result was obtained for the algebraic graph Laplace oper- 
ator L = D — W in |24| . In the presence of negative weights, Theorem 
14.21 is not true anymore. However, for general graphs T G G we have 
the following: 

Corollary 4.1. For a graph V G G we have: 
(i) mi(P) = m (A). 

(ii) The number of isolated strongly connected components in V is 
equal to the minimum number of directed trees needed to span 

r. 

(iii) The number of isolated strongly connected components in T is 
less or equal to the multiplicity of the eigenvalue zero of A. 

Proof. The first two statements follows exactly in the same way as in 
Theorem 14.21 since the proof is not affected by the presence of nega- 
tive weights. The third assertion follows from the observation that for 
every isolated strongly connected component Tj the Laplace operator 
Aj has at least one eigenvalue equal to zero. This observation follows 
immediately from Proposition 14.11 and Proposition 13.11 (i). □ 

5. Directed acyclic graphs 

Definition 5.1. A directed cycle is a cycle with all edges being oriented 
in the same direction. A vertex is a cyclic vertex if it is contained in at 
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least one directed cycle. A graph is an directed acyclic graph if none of 
its vertices are cyclic. The class of all directed acyclic graphs is denoted 

by G ac . 

Note that a directed acyclic graph is not necessarily a directed tree, 
because we do not exclude the existence of topological cycles in the 
graph. If A is represented in the Frobenius normal form, then we 
immediately obtain the following: 

Lemma 5.1. The following three statements are equivalent: 

(i) T E G ac is a directed acyclic graph. 
(ii) Every strongly connected component ojT consists of exactly one 

vertex. 
(iii) A represented in Frobenius normal form is upper triangular. 

Theorem 5.1. 

(i) If T E G ac is a directed acyclic graph, then spec(A) C {0,1}. 

Furthermore, mo (A) = \V \ Vr\ and mi (A) = \Vr\. 
(ii) reG + and spec(A) C {0, 1} if and only ifT E G ac < + . 



Proof. The first part follows immediately from Lemma 15.11 the defini- 
tion of A, and ([7j). Thus, we only have to prove that if V E G + and 
spec(A) C {0, 1} then T E G ac,+ . Assume the converse, i.e. assume 
that r E G + and spec(A) C {0, 1} but T £ G ac ' + . Then, by Lemma 
15.11 there exists a strongly connected component Tj in T consisting 
of at least two vertices. First, assume that Tj is isolated. Then, by 
Lemma FOl exactly one eigenvalue of A, is equal to zero. Using Propo- 
sition [57T] and Corollary 13 .11 we conclude that there exists an eigenvalue 
A E spec(A) s.t. K(A) > ^ > 1 where m = \Vi\ > 1. This is the 
desired contradiction. Now assume that Tj is not isolated. By Lemma 
I4.3[ all eigenvalues of Aj are non-zero. Since T E G + , Pi is non- negative 
and irreducible. The Perron-Frobenius theorem implies that the spec- 
tral radius p of P t is positive and is an eigenvalue of Pj. By (jHj), 1 — p 
is an eigenvalue of Aj that satisfies 1 > 1 — p > 0. Hence, we have a 
contradiction to the assumption that spec(A) C {0, 1}. □ 

Corollary 5.1. If k eigenvalues of A are not equal to or 1, then 
there exists at least k cyclic vertices in the graph. 

6. Extremal eigenvalues 

In this section, we study eigenvalues A of A that satisfy |1 — A| = 
r, i. e. eigenvalues that are boundary points of the disc T>(l,r) in 
Proposition 13.21 
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Definition 6.1. Let r £ G and V be an induced subgraph of I\ The 
induced subgraph V is said to be maximal if all vertices i £ V satisfy 

r(z') = maxr(7) = r, 
where as before 

Z^jeV \ W i3\ 



r[i) 



Note that, if we exclude isolated vertices, then every graph with 
nonnegative weights Y £ G + is maximal. Thus, in particular, every 
connected graph T £ G u+ is maximal. 

Proposition 6.1. Let A ^ be an eigenvalue of A that satisfies 
|1 — A| = r. Then T possesses a maximal, isolated, strongly connected 
component that consists of at least two vertices. 



Before we prove Proposition 16. 11 we consider the following lemma. 

Lemma 6.1. Let A ^ 1, be an eigenvalue of P that satisfies |A| = r. 
Then A is an eigenvalue of the Dirichlet operator P^ that corresponds 
to the strongly connected component Fj~ for some k. Furthermore, Tf, 
consists of at least two vertices and the corresponding eigenfunction u 
for A satisfies \u(i)\ = const for all i £ Vk- 

Proof. From ([6]) and ([7]) it follow that A is an eigenvalue of P& for some 
1 < k < z. Since we assume that A ^ 1 it follows that Vr ^ and 
hence r > 1. This in turn implies that Tj, consists of at least two 
vertices because otherwise by Theorem 15.11 and 0, Pk has only one 
eigenvalue which is either equal to zero or one. So we only have to 
prove that \u(i)\ = const for all % £ T4- 

Assume that |m| is not constant on Vk- Since Tk is strongly connected, 
there exists two vertices i,j in Vk that satisfy Wij ^ and |^(j)| < 
\u{i)\ = maxi 6 i4 \u(l)\. Again, since A ^ 1 it follows that i £ Vr and 



hence we have 



\Pk.u(i) 



^D W W -]af\^ 



d > iev k 



\Wii\\U( 



iav k 



< r(i) max \u(l)\ < rmax |u(7)l- 

iev k iev k 

On the other hand we have 

(12) \Pku{i)\ = |A||«(z)| =rmax|n(/)|. 

iev k 

This is a contradiction to the last equation. □ 
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Now we prove Proposition 16.11 

Proof. For simplicity, we consider P instead of A. Formulated in terms 
of P we have to show the following: Let A 7^ 1 be an eigenvalue of P 
that satisfies |A| = r then T possesses an isolated, maximal, strongly 
connected component consisting of at least two vertices. As in the proof 
of Lemma 16.11 one can show that A is an eigenvalue of the operator P k 
that corresponds to a strongly connected component T^ consisting of 
at least two vertices. 

First we show that all vertices in T^ are not quasi-isolated. Assume 
that at least one vertex, say vertex /, in Tk is quasi-isolated. Then 

P k u{l) =u{l) = \u{l). 

Since A 7^ 1 it follows that u(l) = 0. Thus, we have \u(l)\ < max^g^ \u(j)\ 
which is a contradiction to Lemma [6.11 

Now we prove that Tk is isolated. Assume that Tk is not isolated, 
then there exists a vertex i e 14 and a neighbor j ^ V k of i. Thus, we 
have for the vertex i that 



\P k u{i) 



< 



h iev h 

^— > \Wii\ n 



< 



1 

w 



iev k 



\Wil\\U{ 



max \u( 
ev k 



r[i) max \u{ 
iev k 



< rmax\u(l)\. 
iev k 

On the other hand, we have 

(13) |P fc «(z)| = |A|K»)|=r|«(z)|. 

Comparing these two equations yields 

\u(i)\ < max |u(7)|. 

Again, this is a contradiction to Lemma 16.11 

Finally, we have to prove that the strongly connected component r^ 
is maximal. Assume that T^ not maximal. Then there exists a vertex, 
say i G Vfc, such that r{i) < r. We conclude that 



\P k u(i] 



— Y^w tl u{l) 



iev k 






< 






/ev 



Wiz max ml 



r(z) max |w( 
zev fe 



< r max ml 

iev k 
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Together with ( TT3l) this implies that \u(i)\ < maxi e v k \u(l)\- Again, this 
is a contradiction to Lemma 16.11 □ 

In Proposition 16. II we have to exclude the eigenvalue A = 0. However, 
if we assume that all vertices are not quasi-isolated, Proposition EH] also 
holds for A = 0. 

Proposition 6.2. Let T G G and assume that all vertices are not 
quasi-isolated. If A = is an eigenvalue of A that satisfies |1 — A| — r, 
then there exists a maximal, isolated, strongly connected component 
consisting of at least two vertices in V . 

Proof. Since V = Vr we have for all % G V that r{i) > 1. By assump- 
tion, we have 1 = r and hence r(i) = 1 for all i £ V. This implies that 
every strongly connected component in T is maximal. By Lemma 14.21 
every graph contains an isolated strongly connected component. Since 
A = and we exclude quasi-isolated vertices it follows that there exists 
an isolated maximal strongly connected component in T that consists 
of at least two vertices. □ 

7. /c-PARTITE GRAPHS AND ANTI-£>PARTITE GRAPHS 

7.1. fc-partite graphs. 

Definition 7.1. T G G is fc-partite, k > 2, if df ^ for all « G V 
and the vertex set V consists of k nonempty subsets V\, . . . , Vu such 
that the following holds: There are only edges from vertices j G V^_i 
to vertices i & V q , q — 1, . . . , k, if ^ > and if k is even from vertices 

i 

j G V q+ i to vertices % G V q , q — 1, . . . , k, if ^ < where / = | — 1 G N 

i 

and we identify Vk+\ with V\. 

The condition I — | — 1 G N implies that, in a /c-partite graph, there 
can only exists weights satisfying ^ < if k is even. The special 
choice of / ensures that the distance between different neighbors of one 
particular vertex, say vertex i, is a multiple of |. If the distance of two 
neighbors s, t of i is an odd multiple of |, then s,t belong to different 
subsets and — < 0. If the distance between s, t is an even multiple of 

£, then s,t belong to the same subset and — > 0. 

2' ' & w it 

Theorem 7.1. T G G contains a k-partite isolated maximal strongly 
connected component if and only if 1 — re ±2m k are eigenvalues of A. 

Proof. Again, for technical reasons, we consider P instead of A. Since 
the eigenvalues appear in complex conjugate pairs (Proposition 13.11 
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(ii)), it is sufficient to show that re 2m k is an eigenvalue of P. As- 
sume that T contains a /c-partite isolated maximal strongly connected 
component T p . We claim that the function 



/ 



u\j) 



e 2 ^ ifjeV,,! 
*****? if j e V p , 2 



e 2«i iijeV p>k , 



where V Pt i, . . . , V p ^ is a /c-partite decomposition of V p , is an eigenfunc- 
tion for the eigenvalue re 2m ~k of P p . For any j G V^ g , 1 < q < k, we 
have 



p P u\j) = 4e<% u1 w 

= d* E ^V(i) + ^ w jt u\t) 

= j-J E ^ 2 -V( j) + E ^e-e-in 1 ^) 

= |i E W^^^-iir E l^le-e-i^O') 

1 i I ieV P ! J I iev 



where we used that the /c-partite component T p is isolated and maximal. 
We conclude that re 2m k is an eigenvalue of P p and, by Proposition 14. 11 
re 2m k is an eigenvalue of P. 

Now assume that re 2m * is an eigenvalue of P. Since |re 2,n fc| = r 
and re 2m k ^ 1, Proposition 16.11 implies that T contains an isolated 
maximal strongly connected component T p and re 27 ™fc is an eigenvalue 
of the corresponding Dirichlet operator P p . We only have to prove that 
T p is /c-partite. 
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Let u G C(V P ) be an eigenfunction for the eigenvalue re 2m k . On the 
one hand, since T p is maximal and isolated, all j G V p satisfy 

(14) P p u(j) = re 2 ^u(j) = -±-Y.M e2mlku ^ 

|a i I tev 

(15) = l^£K|e 2 ^(j). 

On the other hand 

(16) fy*(i) = i !>*«(*)■ 

i teVp 

Comparing these two equations yields 

n 7^ v fel = V Wjt M (^ P -2^j 

^ ' ^ \d in \ ^ d in u(i) 

Lemma \6. II implies that the eigenfunction u satisfies \u(t)\ = \u(j)\ for 
all j, t G V p . Thus, ^pre _27r *fc is a complex number whose absolute 
value is equal to one. Since we consider only real weights, we have 
equality in f|T7|) if 

(18) n(j ) =e - 2 ^ M (t), 

whenever ^0 > and 



u(j) = -e- 2m *u(t) = e- nl e- 2nl *u(t) 



whenever -^ < 0. 



First, assume that -& > for all edges in T p . If £ is a neighbor 

i 

of j then the eigenfunction has to satisfy equation ffT8|) . Since T p is 
strongly connected we can uniquely assign to each vertex i a value 
u{€) such that every k-th vertex in a directed path has the same value 

since ( e~ 2m k j =1. Now decompose the vertex set into k non-empty 

subsets s.t. all vertices with the same u- value belong to the same subset 
of V p . This yields a fc-partite decomposition of T p . 

If there also exist edges s.t. ^f < is satisfied, then the crucial 

observation is that if ^ < for some j and t then there has to exist 

another neighbor s of j s.t. ^f > 0. We conclude that every vertex 

j 
j has at least one neighbor s such that ^nf > 0. Thus, there exist 

k different w-values and we can find a fc-partite decomposition of V v 
similarly as in the case studied before. □ 
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Even if we do not require that the fc-partite component is maximal 
we have: 

Corollary 7.1. Let T £ G contain a k-partite isolated strongly con- 
nected component T p , and let r(j) = c for all j £ V p and some constant 
c. Then 1 — ce ±2lTl k are eigenvalues of A. 

Theorem 17.11 can be used to characterize the graph T £ G + whose 
spectrum contains the distinguished eigenvalues 1 — e ±27n ™ in Figured) 
As a special case of Theorem 17.11 we obtain: 

Corollary 7.2. LetT £ G + be a graph withn vertices. Then, 1— e ±2?rJ « 
is an eigenvalue of A(T) iff T is a directed cycle. 

Definition 7.2. The associated positive graph T + £ G + of a graph 
T £ G is obtained from T by replacing every weight Wij by its absolute 
value \wij\. The eigenvalues of T + are denoted by Xq, . . . A^_ 1 and the 
Laplace operator defined on the graph T + is denoted by A + . 

Clearly, a graph T £ G + with nonnegative weights coincides with its 
associated positive graph, i. e. T = T + . 

Remark. It is also possible to define the associated negative graph T~ 
of a graph T that is obtained from T by replacing every weight w^ by 
— \wij\. Note however, that by Proposition 13.11 (v) the graphs T~ and 
r + are isospectral. Thus, we will only consider r + in the following. 

Theorem 7.2. Let T £ G be a k-partite graph and r(j) = r for all 
j £ V. Then, the spectra of A + and A satisfy the following relation: 
A+ £ spec(A+) iff 1 -re ±2 ^i(l - A+) £ spec(A). 

Proof. Let the function u satisfy A + u = X + u. We define a new function 
v in the following way: 



(19) v(j) 



e 2m MJ) if J^i 
e 2 ^u(j) if jev 2 



e 2 ^u(j) if jeV k 



where Vi, . . . ,Vk is a fc-partite decomposition of V. We show that v 
is an eigenfunction for A and the corresponding eigenvalue is given by 
(1 — re~ 2nl k (1 — A + )). For any j £ V q and 1 < q < k, we have 
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Av(j) = v(j) -~jiE Yl w i tV ^ ~>E w ^) 
i tev g _i 



K n 



tev a . 




e™lu(j) - re 2 ^u(j) + re 2 ^ u(j) - -— £ \w Jt \u(t) 



tev 



=A+u(j)=X+u(j) 

= (l-re- 2 ^(l-A + )Mj). 

Since the edge weights are real, A can be represented as a real matrix 
and hence v is an eigenfunction for the eigenvalue 1 — re 2m k (1 — A + )). 
The other direction follows in a similar way. To be more precise, for 
an eigenfunction v of A we define the function u by 



(20) u(j) 



e 2 ^v(j) if jeV, 



e 2m *v(j) if jEV 2 



e 2 ™iv(j) if j £ V k . 



As above, one can show that u is an eigenfunction for A + and corre- 
sponding eigenvalue 1 — -e~ 2nl k(l — A). □ 

Note that in Theorem 17.21 we do not assume that T is strongly con- 
nected. However, if we assume in addition that T is strongly connected, 
then we have the following result: 

Corollary 7.3. Let T £ G be a strongly connected graph, and r(j) = r 
for all j £ V. Then, T is k-partite if and only if the spectra of A + and 
A satisfy the following: A + is an eigenvalue of A + iffl— re ±2m * (1 — A + ) 
is an eigenvalue of A. 

Proof. One direction follows from Theorem 17.21 The other direction 
follows from the observation that zero is an eigenvalue of A + and thus 
1 — re ±2nl k is an eigenvalue of A. Since T is strongly connected, it 
follows from Theorem 17.11 that the whole graph is fc-partite. □ 

Moreover, a fc-partite graph has the following eigenvalues: 
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Proposition 7.1. Let T G G be a k-partite graph and r(l) = r for all 
I G V. Then, 1 — re 2m ~k G spec(A) for 1 < m < k — 1 and m odd. If, 
in addition, ^0- > for all j,t G V , then 1 — e 2m ~k G spec(A) for all 



3 



0<m<k-l. 

Proof. In order to prove that 1 — re 2nl ~ is an eigenvalue of A, it is 
sufficient to show that re 2m ~ is an eigenvalue of P. Consider the 
functions 



(21) u m {j) 



e 2m ~ if j e V 1 

r, ■ m(k — l) 

e 2m ^i^ if j g V 2 



■ ml 



e 2«T if jeV k 

for m = 0, 1, ... A;— 1. One easily checks that these functions are linearly 
independent if k > 2. 

For all j G V q , q — 1, . . . , k, and 0<m<fc-lwe have 

p« m u) = 4 E ^ m (*) + 4 E «*« m (*) 

J <ev 9 _! J tev q+l 

= J_ y \ Wjt \e 2 ^fu m (j) - 4t F k Jt |e- 2m ^ M m (j) 
1 j ' *ev,-i ' J ' tev q+l 

(22) = r4 E Kl^**"^) - r4 E K^l^e— «»(;)■ 
1 a i ' tev,_i |tt ^ I t£V q+l 

If m is odd, then e _7Um = — 1 and thus 

pu m {j) = ,4 E ki^^o') 

|tt i I tev 
= re 2 "t u m (j). 

Hence, 1 — re 2m ~£ for 1 < m < k — 1 and m odd is an eigenvalue of A. 

If in addition ^ > for all j and t in V, then r = 1 and there are 

df 

only edges from vertices in V q ~\ to vertices in V q . Thus, the second 
term on the r.h.s. of fl22l) vanishes and we can conclude that 



p« m u) = 4e \^\e 2 -fu-(j) = ^\2\ w ^ e2mfum ^ 

' ■?' ' tev„-i I J I tev 



re 2 ^u m (j) = e 2ni fu m (j). 
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This shows that 1 - 


- e 27 "ir for all m = 


0,.. 


.,*- 


• 1 is an eigenvalue of 


A. 








D 



7.2. Anti-A;-partite graphs. In this section, we study graphs that are 
closely related to A;-partite graphs. We call those graphs anti-fc-partite 
graphs since they have the same topological structure as fc-partite 
graphs but compared to fc-partite graphs, the normalized weights ^ 
in anti-/c-partite graphs have always the opposite sign. 

Definition 7.3. r G G is anti-fc-partite, for k > 2 and k even, if 
d™ 7^ for all % G V and the vertex set V consists of k nonempty 
subsets Vi, . . . , Vk such that the following holds: There are only edges 
from vertices j G V q -\ to vertices i G V q if -& < or from vertices 

i 

j G V q+ i to vertices i G V q if ^jf > where / = | — 1 G N and we 
identify Vk+i with V\. 

In contrast to fc-partite graphs, anti-fc-partite graphs can only be 
defined if k is even. This follows from the observation that every vertex 
i has at least one neighbor j such that ^ > 0. Hence, every vertex 
i G V q has at least one neighbor in V q+ i for q = 1, . . . , k. Since we 
require that I — | — 1 G N, it follows that k has to be even. 

We mention the following simple observation without proof: 

Proposition 7.2. Let T G G + be an anti-k-partite graph and k = 
2 + 4 m , where m = 0, 1, . . .. Then, T is disconnected and if m > 1 T 
consists of two —partite connected components. 

Theorem 7.3. Let T G G contain an anti-k-partite maximal, isolated, 
strongly connected component, then 1 + re ±2nl k G spec(A). Further- 
more, if 1 + re ±2m k G spec (A) and one of the following two conditions 
is satisfied 

(i) k = 4 m for m = 1, 2, . . . 

(ii) k = 2 + 4 m for m = 0, 1, . . . and r > I, 

then T contains an anti-k-partite isolated maximal strongly connected 
component. 

Proof. Assume that T contains an anti-fc-partite maximal, isolated, 
strongly connected component. In exactly the same way as in The- 
orem 17.11 one can show that 1 + re ±2m k is an eigenvalue of A. We 
will omit the details here. Now let 1 + re ±2m k be an eigenvalue of A. 
Note that 1 + re ±2m k ^ and thus, by Proposition 16. 1[ T contains an 
maximal, isolated, strongly connected component T p . Furthermore, we 
have that 1 + re ±2m k is an eigenvalue of A p . By a reasoning similar to 
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the one in the proof of Theorem 17.11 it follows that the corresponding 
eigenfunction for A p satisfies 



(23) 






«0") = - 


-e 2 ^ 


u(t) 














whenever 


Wjt 


> and 




















(24) 






u(j) = 


e 2 ^u(t) 














whenever 


d 1 " 


< 0. Now 


assume 


that 


k = 


4 m 


and 


w tj 


> 





for all 



t,j eV p . 

Since T p is strongly connected, k = 4 m , and neighbors have to satisfy 
equation (T23]) . we can uniquely assign to every vertex an u- value such 
that every A;-th vertex in a directed path has the same w-value. Now 
decompose the vertex set into k non-empty subsets such that all vertices 
with the same u- value belong to the same subset. This yields an anti- 
fc-partite decomposition of T p . 

If there also exists edges s.t. ^nf < is satisfied then, again, the 

crucial observation is that if ^ < for some j and t then there also 
has to exist another neighbor s of j s.t. -# > 0. Thus, there exist 

k different M-values. Similar to above, we can find an anti-fc-partite 
decomposition of V p . 

If k = 2+4 m , m = 0, 1, . . . , the situation is different. If ^ > for all 

j and t, then r = 1. In this case, we cannot conclude that there exists an 
anti-/c-partite component since already every |-th vertex in a directed 

path has the same w-value, i.e. (— 1) 2 (e 27 "fc)2 = 1 for k = 2 + 4 m , 
m = 0, 1, . . .. Thus, we crucially need that r > 1. In this case, every 
vertex i has at least one neighbor j such that -£ < 0. By (1241) it follows 

that there has to exist k different w-values. Thus, we can obtain an 
anti-fc-partite component of T p in the same way as before. □ 

A simple example that shows that the assumption r > 1 is necessary 
if k = 2 + 4 m in the last theorem. If 1 — r = is an eigenvalue of T, 
then this does not imply that there exists a 2-partite isolated maximal 
strongly connected component in T. 

The next theorem shows that there also exists a relationship be- 
tween the spectrum of an anti-/c-partite graph and its associated posi- 
tive graph. 

Theorem 7.4. Let Y G G be an anti-k -partite graph and r(l) = r for 
all I E V. Then, \+ G spec(A+) iff 1 + re ±2 ^(l - A+) G spec(A). 
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We omit the proof of this theorem because it is the same as the proof 
of Theorem 17.21 

The next proposition is the corresponding result to Proposition 17.11 
in the case of anti-/c-partite graphs. 

Proposition 7.3. Let T G G be an anti-k-partite graph, s.t. r(l) = r 
for all I G V, then 1 + re 2m ^ G spec(A) for < m < k — 1, if m is 
odd. If in addition ^ > for alli,j G V then l — e 27Tl ~ G spec(A) for 

< m < k — 1, m even and 1 + e 2m ~k g spec(A) for < m < k — 1, 
m odd. 

Proposition 7.4. LetT G G be a strongly connected graph andr(l) = r 
for all I G V . Assume that k = 4 m , m = 1,2,.... Then, T is k-partite 
iffY is anti-k-partite. 

Proof. Assume that V is /c-partite. By Proposition 17. 1[ 1 — re 27 ™* G 
spec (A) for < / < k — 1 and / odd. Since k is of the form k = 4 



in 



k 



| + 1 is odd, and so we have 1 — re 2m ~ ~ = l + re 27 ™* G spec(A). From 
Theorem 17.31 it follows that T is anti-fc-partite. The other direction 
follows in the same way by using Proposition 17.31 and Theorem 17.11 □ 

This proposition shows that if k = 4 m , m = 1, 2, . . . then a /c-partite 
decomposition can be obtained from an anti-/c-partite one, and vice 
versa, by relabelling the vertex sets Vk- 

7.3. Special cases: Bipartite and anti-bipartite graphs. 

7.3.1. Bipartite graphs. As a special case of /c-partite graphs we obtain: 

Definition 7.4. A graph r G G is bipartite (or 2-partite), if <i™ 7^ for 
all i G V and the vertex set V can be decomposed into two nonempty 
subsets Vi, V2 such that for neighbors i and j ^ > if % and j belong 

to different subsets and ^ < if i and j belong to the same subset. 

i 

In the case of undirected graphs with nonnegative weights, Definition 
17.41 reduces to the usual definition of a bipartite graph. 

Corollary 7.4. A graph V G G contains a maximal, isolated, bipartite 
strongly connected component if and only if 1 + r is an eigenvalue of 

A. 

Using Corollary 13.11 we can reformulate this as follows: 

Corollary 7.5. The spectrum of A contains the largest possible real 
eigenvalue if and only if the graph Y G G contains a maximal, isolated, 
bipartite strongly connected component. 
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For undirected graphs with nonnegative weights, Corollary 17.41 re- 
duces to the well-known result that T is bipartite if and only if 2 is an 
eigenvalue of A. 

Corollary 7.6. Let T G G be a bipartite graph and r(l) = r for all 
I G V. Then, A+ G spec(A+) iff 1 + r(l - A+) G spec(A). 

In particular, if V G G + is strongly connected, then V is bipartite if 
and only if with A also 2 — A is an eigenvalue of A, i. e. the real parts 
of the eigenvalues are symmetric about one. 

7.3.2. Anti-bipartite graphs. As a special case of anti-fc-partite graphs 
we obtain: 

Definition 7.5. A graph r G G is anti-bipartite, if d 1 * 1 ^ for alH G V 
and the vertex set V can be decomposed into two nonempty subsets 
such that for neighbors i and j, ^f < if i and j belong to different 

subsets and ^ > if i and j belong to the same subset. 

i 

Lemma 7.1. V G G + is anti-bipartite if and only if the graph T is 
disconnected and d™ ^ for all i. 

Proof. One direction follows from Proposition 17.21 

Now assume that the graph V G G + is disconnected and d 1 * 1 ^ for 
all i. Then there exists at least two connected components such that 
-jg- > for all neighbors i and j. Distribute the connected components 

(there exist maybe more than two) into two nonempty subsets V\ and 
V-i. This is an anti-bipartite decomposition of the graph. □ 

Corollary 7.7. Let r > 1, then 1 — r is an eigenvalue of A if and 
only if the graph contains an anti-bipartite maximal isolated strongly 
connected component. 

Using Corollary 13.11 we can reformulate this as follows: 

Corollary 7.8. Assume that r > 1 is satisfied. The spectrum of A 
contains the smallest possible real eigenvalue if and only if the graph 
r G G contains a maximal, isolated, anti-bipartite strongly connected 
component. 

Example 2. Consider the graph in Figure [3j It is easy to calculate 
the spectrum of this graph by using the results derived in this section. 
First, note that the graph in Figure [3] is bipartite and anti-bipartite. 
Since r(i) = 3 for all i, we have 1 ± 3 G spec(A). Zero is always an 
eigenvalue of A. The last eigenvalue is equal to 2 since J2i -^ = |Vr| = 
4. So we have determined all eigenvalues of the graph in Figure [3j 
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Figure 3. Eigenvalues of A are 4, 2, 0, -2 



8. Bounds for the real and imaginary parts of the 

eigenvalues 

In this section, we will derive several bounds for the real and imagi- 
nary parts of the eigenvalues of a directed graph. In the following, we 
also allow loops in the graph. This slight generalization is particularly 
important in the next section where we introduce the neighborhood 
graph technique. It is straightforward to generalize the Laplace oper- 
ator A to graphs with loops. The normalized graph Laplace operator 
for directed graphs with loops is defined as: 

A : C{V) -> C(V), 



(25) 



Av(i) 



VIZ) 



^Ej^Aj) if<V0 







else. 



The only difference to graphs without loops is that now Wa is not always 
equal to zero. As for graphs without loops we define P = I — A. 
Furthermore, we say that vertex % is in-isolated or simply isolated if 
Wij = for all j G V. Similarly, vertex % is said to be in-quasi-isolated 
or simply quasi-isolated if df 1 = 0. In particular, an isolated vertex 
cannot have a loop. As before, Vr :— {i G V : df 1 ^ 0} is the set of all 
vertices that are not quasi-isolated. 

8.1. Comparison theorems. In this section, we show that the real 
parts of the eigenvalues of a directed graph can be controlled by the 
eigenvalues of certain undirected graphs. Together with well-known es- 
timates for undirected graphs these comparison results yield estimates 
the realparts of the eigenvalues of a directed graph. 
We need the following definition: 

Definition 8.1. Let T G G be given. The underlying graph U(T) G G u 
of T is obtained from T by replacing each directed edge by an undirected 
edge of the same weight. In U(T) we identify multiple edges between 
two vertices with one single edge. The weight of this single edge is 
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equal to the sum of the weights of the multiple edges. Furthermore, 
every loop in T is replace by a loop of twice the weight in U(T). 

Note that the correspondence between directed graphs and their un- 
derlying graphs is not one to one. Indeed, many directed graphs can 
have the same underlying graph. 

We recall the well-known concept of majorization: 

Definition 8.2. Let a 6 1R™ and b G W 1 be given. If the entries of a 
and b are arranged in increasing^ order, then b majorizes a, in symbols 
a -< b, if 



k 



(26) J2 a *-J2 h 

and 



n 



i=\ i=\ 



(27) E a * = X> 

We will need the following two results: 

Lemma 8.1. [R. Rado, see e.g. [17] p. 63 or [21]/ If x -< y on MJ 1 and 

a -< b on W 71 then (x, a) -< (y, b) on W l+m , where (x, a) is the vector 
composed of the components of x and a arranged in increasing order, 
and similarly for (y, b). 

In particular, Lemma 18.11 shows that the majorization property is 
preserved if we append the same entries to both x and y (choose a = b 
in Lemma 18. ip . 

In the sequel, let the symmetric part of a matrix M be denoted by 
S(M) := \{M + M T ). We make use of a classical result by Ky Fan 
H51: 



Lemma 8.2. Let X(S(M)) and 9ft[A(M)] denote the column vectors 
whose components are the eigenvalues of S(M) and the real parts of 
the eigenvalues of M , respectively. If the components of \(S(M)) and 
3?[A(M)] are arranged in increasing order, then for every matrix M we 
have 

X(S(M)) -< 9?[A(M)]. 



*The definition of majorization is not unique in the literature. Here, we follow 
the convention in [15] . In other books, see e.g. [3T|, majorization is defined for 
vectors arranged in decreasing order. Reversing the order of the elements has the 
following consequence: If a and b are two real vectors whose entries are arranged in 
increasing order, and A and B denote the vectors with the same entries arranged 
in decreasing order, then a -< b if and only if B < A. 
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Using Definition 18.11 and Definition 18.21 we state the following com- 
parison result. 

Theorem 8.1. IfT&Gis balanced, then 

A(A(tf(r))HR[A(A(T))], 

i. e. the eigenvalues of the underlying graph U(T) are majorized by the 
real parts of the eigenvalues ofT. 

Proof. Recall the definition of the reduced Laplace operator Ar = 
Ir — D R Wr in Eq. (j4]). It is straightforward to generalize Ar for 
graphs with loops. Here however, instead of Ar we consider the re- 
duced normalized Laplace operator Cr :— Ir — D r WrD r . In the 
sequel, we will study matrix representations of A^ and Cr that will 
also be denoted by Ar and Cr. Since D R is nonsingular and 

A R = D R 1/2 'X R D)l 2 , 

it follows that Cr and A# are similar and hence have the same spec- 
trum. We claim that the reduced Laplace operator Cr satisfies 

S(C R (T)) = C R (U(T)). 

Since T is balanced, the degrees of the vertices satisfy 

(28) 2d?(T) = di(U(r)). 

Thus, in particular, the number of quasi-isolated vertices in U(T) and 
T is the same and so the matrices S(Cr(T)) and Cr(U(T)) have the 
same dimension. 

By definition, the diagonal elements satisfy 

S(£s(r)) - = : - TwmW) 

and 

Uu(Dh = i- & „ =i 2w " 



by ( |28l) . For the off-diagonal elements, we have 



s(c R (r)) i:i = -i/2 ' 



f dY(TJdf{F) y J<f(T)<fr(r) j 
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and 

£*(tf(T))« = Wii + Wji 



vmmwwY) 



L 'Jl 



= -1/2 

^/dfiT)df(T) 

where we used (128]) . This proves our claim. Now it follows that 

A(A R (C/(r))) = \(£r(U(T))) = X(S(C R (T))) -< X(\(£ R (r))) = »(A(A a (r))), 

where we used Lemma 18.21 and the fact that Cr and A# have the 
same spectrum. By (J3J), the spectrum of A(r) (A(f/(r))) consists of 
all eigenvalues of A#(r) (Ar(U(T))) and |V\ Vr\ times the eigenvalue 
zero. From (1281) it follows that the number of quasi-isolated vertices is 
the same in U(T) and I\ Hence Lemma 18 .11 implies 

A(A(t/(r))) -< »[A(A(r))]. 

D 

Theorem 18.11 is used in [1] to compare the synchronizability of di- 
rected and undirected networks of coupled phase oscillators. 

In particular Theorem 18.11 implies: 
Corollary 8.1. For a balanced graph reGwe have 
minA,,(A([/(r))) < minK(A J (A(r))) 

and 

max3J(Ai(A(r))) < max A,(A([/(r))), 

i i 

where Xq = is the eigenvalue corresponding to the constant function. 

Corollary 18.11 can now be used to derive explicit bounds for the real 
parts of the eigenvalues of a balanced directed graph by utilizing eigen- 
value estimates for undirected graphs. For that reason, we recall the 
definition of the Cheeger constant and the dual Cheeger constant of an 
undirected graph. 

Definition 8.3. For an undirected graph the Cheeger constant h is 
defined in the following way [7]: 

(29) h := min W^l _ , 

wcv mm{vo\(W), vol(W)} 

where W and W = V \ W yield a partition of the vertex set V and 
W, W are both nonempty. Here the volume of W is given by volfW) := 
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^2 i€W di. Furthermore, E(W,W) C E is the subset of all edges with 
one vertex in W and one vertex in W, and |.E(W, W)\ := Ylik&wi&w Wkl 
is the sum of the weights of all edges in E(W, W). Similarly, the dual 
Cheeger constant h is defined as follows [I]: For a partition Vi, V2, V3 
of the vertex set V where V\ and Vi are both nonempty, we define 

(30) h := max — — — 77777- 

Vt,v 2 vol(Vi) + vol(F 2 ) 

Although, it seems that h does not depend on V3, h is well-defined. In 
order to see this we note that for a partition Vi, V2 and V3 of V, the 
volume of Vi can also be written in the form 

3 

(31) vol(V,) = J2\E(V l ,V J )\ 

3=1 

Consequently, h is given by 

2\E(V U V 2 )\ 



(32) h = max — 5 

and hence depends on V 3 . 

It is well known that the Cheeger and the dual Cheeger constant 
control the eigenvalues of undirected graphs with nonnegative weights. 

Lemma 8.3. For an undirected graph with nonnegative weights V G 
G u+ we have: 

(i) [7] The smallest nontrivial eigenvalue Ai satisfies 

1 - Vl - h 2 < Ai < 2h. 
(ii) [1] T/ie largest eigenvalue X n -i satisfies 



2h< A n _i < l + y'l-(l-/i) 2 . 
Combining Lemma [8.31 with Corollary 18.11 we obtain: 
Theorem 8.2. Let V G G + be a balanced graph, then 

< 1 - y/l-h 2 {U{T)) < minK(Ai(A(r))) 

and 



max3J(Ai(A(r))) < 1 + Jl - (1 - h{U{T))) 2 < 2, 

i » 

where h(U(T)) and h(U(T)) are the Cheeger constant and the dual 
Cheeger constant of the underlying graph U(T). 
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Proof. Corollary Oimplies that min^ Ai( A (f/(r))) < min^ ^(Ai(A(r))) 
and max; »(A<(A(r))) < max; Xi(A(U(T))). Since U(T) G G u+ , we can 
use the estimates in Lemma [8 .31 to control the eigenvalues of A(U(T)). 
This completes the proof. □ 

Theorem 18.21 allows us to interpret the smallest nontrivial realpart 
and the largest realpart of the eigenvalues of a balanced directed graph 
T G G + in the following way: If the smallest nontrivial realpart of a 
balanced directed graph is small, then it is easy to cut the graph into 
two large pieces and if the largest realpart is close to 2 then the graph is 
close to a bipartite one. We illustrate this by considering the following 
example. 

Example 3. We consider the directed cycle C n of length n. Since 
C n is a n-partite graph its eigenvalues are given by 1 — e 2m ™ for k = 
0, 1, . . . ,?i—l. This implies that min^o $l(K) = 1 — cos(— ) — > as n — > 
oo and maxj 3?(Aj) = 2 if n is even and maxj 9ft(Aj) = 1 — cos( — -ir) — > 2 
if n is odd as n — > oo. Since C n is balanced, Theorem 18.21 implies that it 
is easy to cut C n into two large pieces (if n is sufficiently large) and C n 
is bipartite if n is even and close to a bipartite graph if n is sufficiently 
large and odd. Indeed, C n is bipartite if n is even, close to a bipartite 
graph if n is odd, and we only have to remove two edges in order to 
cut C n into two large pieces. 

Of course, any other eigenvalue estimate than the Cheeger esti- 
mate and the dual Cheeger estimate leads to similar estimates as in 
Theorem 18.21 In particular, one can control, minj^o^A^AfT))) and 
maxj3ft(Aj(A(r))) in terms of the diameter [H [20] , the Olliver-Ricci 
curvature [S] or arguments involving canonical paths [T5] . 

Now we derive a second comparison theorem that leads to further 
eigenvalue estimates. Instead of using the underlying graph U(T), we 
use in the following a different undirected graph T to control the eigen- 
values of directed graphs. 

We say that the operator P = I — A is irreducible if its matrix 
representations are irreducible. It is easy to see [18] that P is irreducible 
if the graph T is strongly connected and Vr = V, i.e. d™ ^ for all i. 
If we restrict ourselves to strongly connected graphs with nonnegative 
weights, the Perron-Frobenius Theorem [TS] implies that there exists a 
positive function (i.e. 0(i) > for all i G V) that satisfies 

(33) Y,^^) = P m = m vi, 

7 3 
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where p — 1 is the spectral radius of P. The function is sometimes 
called the Perron vector of P and is used in the following construction. 

Definition 8.4. Let T = (V, E) G G + be a strongly connected graph. 
The graph T = (V, E) G G u+ is obtained from V by replacing every 
weight Wij by 

<% = ^(0 + ipo'). 

Since the weights of the edges are nonnegative and the function 
is positive, V G G u+ is an undirected graph with nonnegative weights. 
The degree d{ of any vertex i G V in the new graph V is given by 

(34) I = J>, = £ J^0(z) + £ ^0(j) = 20(0, 

where we used the definition of the in-degree o?J n and (133]) . 
Theorem 8.3. Let T G G + fre an strongly connected graph, then 
minA i (A(f)) < min3?(A i (A(r))) < max3?(A i (A(r))) < maxA;(A(f)). 

Proof. For ease of notation we set A = A(r) and Aj = Aj(A(r)). We 
consider the inner product for functions f,g G C(V), 



(f,g) =^2dif(i)g(i), 



where f(i) denotes complex conjugation. Using (|34"|) . we obtain the 
following identity: 

= (/. /) - E ^(o/w/y) - E ^<t>uW)m 



(P w w w ' ^ d 



J 



= (/, /) - E f /« E 3^') - E |/0') E ^7(0 

= (/,/)-^(/, J p/)-^(7,i 3 7) 

Let Mfc and jk, fc = 0, ... ,n — 1 be the eigenfunctions and the cor- 
responding eigenvalues of P. Without loss of generality, we assume 
that m is given by the constant function 1 = (1,...,1) T and 70 = 1. 
Suppose for the moment that (uk, 1) = («&, u ) = for all fc ^ 0. 
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Since T e G u+ we can use the usual variational characterization of the 
eigenvalues. For all k 7^ we have 

~ . t (f,Af) ^ (u k ,Au k ) 

(uk,u k ) _ 1 (u k ,Pu k ) _ 1 (uT, PUk) 
(u k ,u k ) 2 (u k ,u k ) 2 (u k ,u k ) 

= l-^7fc-^=l-»(7fc) = »(A fc ), 

where we used the fact that if u k is an eigenfunction for the eigenvalue 
7k then u k is an eigenfunction for the eigenvalue 7&. Similarly, we 
obtain for the largest eigenvalue A n _i 

r Of, 4/) ^ (u k ,Au k ) 

A n _i = sup > = U{X k ) 

/#o (/,/) (w fc ,w fc J 

for all fc. Therefore, it only remains to show that (u k , 1) = for all 
k 7^ 0. The Perron- Frobenius Theorem implies that p = 70 = 1 is a 
simple eigenvalue of P and hence 7^ < 1 for all k 7^ 0. Using (}33l) and 
(EH) we obtain 



(wit, 1) = y^Mfc(z) 

i 

= J^20(i)u fc (i) 



E 2 E^>*(«) 






= z^&tihkUkij) 

This implies that 

(2-2 7fc )^0(zH(z) = O. 

i 

Since 7^ < 1 if k 7^ 0, we conclude that ^^ 0(i)ii fc (i) = and hence 
(u k , 1) = 0. This completes the proof. □ 

By combining Lemma \8. 31 with Theorem I8.3[ we immediately obtain 
the following eigenvalue estimates: 
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Theorem 8.4. Let T £ G + be a strongly connected graph, then 



< 1—y/l - h 2 (T) < min»(Ai(A(r))) < max§ft(Ai(A(r))) < l + \/l - (1 - h(T)) 2 < 2, 

where h(T) and h(T) are the Cheeger constant and the dual Cheeger 
constant of the graph T. 

Remark. The estimates in Theorem 18. II are in particular true for graphs 
with both positive and negative weights. In contrast, the estimates in 
Theorem 18 .31 only hold for graphs with nonnegative weights. However, 
the assumption in Theorem 18.31 that the graph is strongly connected 
is weaker than the assumption in Theorem 18.11 that the graph is bal- 
anced. Indeed, it is easy to show that every balanced graph is strongly 
connected but not vice versa. 

8.2. Further eigenvalue estimates. In the last section, we derived 
eigenvalue estimates for directed graphs by using different comparison 
theorems for directed and undirected graphs. In this section, we prove 
further eigenvalue estimates that do not make use of comparison the- 
orems. By considering the trace of A 2 , we obtain estimates for the 
absolute values of the real and imaginary part of the eigenvalues. 

Theorem 8.5. Let T £ G be a graph. Then, 



min|»(A0| < 



\ 



\ V R\ + Y.i€V R \(df) 2 2 4" J + 2 S(i,i)e*7 [ dfdf) + Yji=m n ^ 



\> 



n — tuq 
< max|5R(Ai)| 

i 

where U C VrxVr is the set of distinct mutually connected vertices that 
are not quasi-isolated, i. e. (i,j) £ U, if i ^ j, and df, dj-,Wij, w^ ^ 0. 
As before, m^ denotes the multiplicity of the eigenvalue zero of A. 

Note that for undirected graphs, the set U is a subset of the edge set 
E. In particular, if Vr = V, and there are no loops in the graph then 

U = E. 

Proof. First, we note that the trace of A 2 satisfies 
(35) 

n—l n—l n—l n— 1 

Tr (A 2 ) = Tr (A 2 ,) = £ A 2 = £ A 2 = £ ^A,) 2 - £ 3(A,) 2 , 

i=0 i=mo i=mo i=rriQ 



NORMALIZED GRAPH LAPLACIANS FOR DIRECTED GRAPHS 35 

where the last equality in ( 135|) follows from the observation that the 
eigenvalues appear in complex conjugate pairs. An immediate conse- 
quence of Eq. (135)) is: 
(36) 

(\ 2 n-1 

min |3fc(Ai)| ) < Tr (A%)+ V 3(A,) 2 < (n-m ) fmax|3ft(A, 



i=mo 



On the other hand, the trace of A 2 R is given by: 

Tr(A 2 B ) = Tr(I R )-2Tr(D R 1 W R ) + Tr((D- R 1 W R ) 2 ) 



it/ I _ 9 V^ — + V^ (— \ + V^ Wij Wji 

1 Rl A? df 1 2-f \df) . . ^. df df 



(37) = l^l~2E|f + Ete) 2 + 2E 



wu t s^ (Wii\ , n v^ W *J w i» 

d in d in 
ieVfl ~ J ieVii X ~ J / (i,j)eu l 3 



Combining (136]) and (|37|) completes the proof. D 

From this theorem, we can derive interesting special cases. 

Corollary 8.2. // there are no loops and no mutually connected ver- 
tices in Vr, i. e. wu = for all i, and U = ; then 



IT/ I a. y^" -1 cjm \2 

min M\i)\ < \l— ^ l=m ° K l) < max 13^)1. 

i-.Xi^o' " y n-m i 

Corollary 8.3. LetT be a loopless, undirected, unweighted, and regular 
graph, i. e. w^ G {0, 1}, w^ = Wji, and di = J2j w ij = k ,Vi £V, then 



min A; < \l ^ = J- — - < max A,. 

j^o y n-1 y (n — l)fc % 

The next example shows that this estimate is sharp for complete 
graphs. 

Example 4. For a complete graph on n vertices the estimate in Corol- 
lary 18.31 yields 

n 

minAj < < max A;. 

i^o n — 1 * 

On the other hand, all non-zero eigenvalues of a complete graph are 
given by -^-. Hence, the estimate in Corollary l8.3l is sharp for complete 
graphs. 

In the same way, we can obtain bounds for the absolute values of the 
imaginary parts. 
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Theorem 8.6. 



min |3f(Aj)| < 



\ 



Z^j=m ^( A i) 2 Z^(j,j)GC7 \ Jfdf ) + ^i£V R [^ rfn (sf) 2 ) \^ R \ 



n — m 



< max|Q : (Aj)| 

i 

We obtain the following special case: 

Corollary 8.4. // there are no loops and no mutually connected ver- 
tices in Vr, i. e. wa = for all i, and U = 0, then 



mm |<J(Aj)| < \ < max |b(Ai)|. 



'R 



9. Neighborhood graphs 

In [1] we introduced the concept of neighborhood graphs for undi- 
rected graphs T G G u+ . Here, we generalize this concept to directed 
graphs r eG without quasi-isolated vertices. As already mentioned 
above, for the concept of neighborhood graphs it is crucial to study 
graphs with loops. Hence, we will consider graphs with loops in this 
section. 

Definition 9.1. Let T = (V, E) e G and assume that df ^ for all 
i G V. The neighborhood graph T[l] = (V,E[l]) of order / > 2 is the 
graph on the same vertex set V and its edge set E[l] is defined in the 
following way: The weight w^ [I] of the edge from vertex j to vertex % 
in r[Z] is given by 

w iA l \ = Yl ^T • • ■ J^ w iki w kik2 ■ ■ ■ w h-d- 
ki,...,ki-i hl k '- 1 

In particular, j is a neighbor of i in T[l] if there exists at least one 
directed path of length / from j to i in T. 

Another way to look at the neighborhood graph is the following. 
The neighborhood graph T[l] of the reversal graph T encodes the tran- 
sition probabilities of a /-step random walk on I\ For a more detailed 
discussion of this probabilistic point of view, we refer the reader to [S]. 

The neighborhood graph T[l] has the following properties: 

Lemma 9.1. 

(i) The in-degrees of the vertices in V and T[l] satisfy 

df = df[l] VieV andl> 2. 
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(ii) IfY is balanced, then so is T[l] and the out-degrees of the vertices 
in T and T[l] satisfy 

rf° ut = rf° ut [/] VieV andl>2. 
Proof, (i) We have 

j k lt ...,ki-i kl kl ~ 1 J 

= Y -^ ■ ■ ■ -^^ w iki w kxk, -Y w *«- 3 *.-i 

fcl,...,fcl-2 fc l fc '"2 A:;.! 



^ W ikl = d \ 



c 

fcl 



(ii) Since T is balanced, we have d° nt = d™ 1 for alii e V^ and thus 

dT*P] = z2 w ji[ l ] = Y ^r ■ ■ ■ ^ta - Wfe i fc 2 • • • ^-2^-i^-ii XI w ^ 

j ki,...,ki-l kl kl ~ 1 3 

d out 1 1 

Y "jST 3E" * ' • IE - Wfc 2 fc 3 • • • U>fc,_ 2 *,_iU>k,_ii X Wfc i fc 2 

fc 2 ,.--A-l "*1 Gfc 2 "*»-! fcl 



X w^^ = d 



out 



Jill 



Consequently, if T is balanced, then we have for all i, d\ n [l] = d\ 
d° nt = d° nt [l] and hence T[l] is balanced. □ 

The next theorem establishes the relationship between A and A[Z]. 

Theorem 9.1. We have 

(38) I-(I-A) l = I-P l = A[/], 

where A[l] is the graph Laplace operator on T[l] and A is the graph 
Laplace operator on T. 

The proof is essentially the same as the proof given in [I] for undi- 
rected graphs. So we omit the details here. 

Corollary 9.1. The multiplicity mi of the eigenvalue one is an invari- 
ant for all neighborhood graphs, i. e. mi(A) = mi(A[/]) for all I > 2. 
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Proof. T and T[l] have the same vertex set, thus both A and A[l] = 
I — (I — A) 1 have n = \V\ eigenvalues. By Theorem 19.14 every eigen- 
function Uk for A and eigenvalue A& is also an eigenfunction for A[l] 
and eigenvalue 1 — (1 — A^)'. Thus, the corollary follows from the 
observation that 1 — (1 — X^) 1 = 1 iff A& = 1. □ 

As in [1] , the relationship between the spectrum of a graph and the 
spectrum of its neighborhood graphs can be exploited to derive new 
eigenvalue estimates. For example we have the following result: 

Theorem 9.2. Let T be a graph and T[l] be its neighborhood graph of 
order I > 2 . 

(i) If 1 < A[l] < min^ \\i[l]\, then (A[l] - 1)t < \l - \\ for all 

i ^ 0, where A[l] is any lower bound for min^o |-M(II- 
(ii) 7/min^ |Ai[/]| < B[l] < 1, then (1 - B[1])t < max^l - A*|, 

where B[l] is any upper bound for min^o M(!l- 
(Hi) If 1 <C[l] <maxi\\i[l]\, then (C[l] — 1) T <maXj|l — A»] , where 

C[l] is any lower bound for maxj |Aj[/]|. 
(iv) Ifmaxi \\[t\\ < V[l] < 1, then (1 - V[l])r < |1 - \\ for all i, 

where T>[1] is any upper bound for max; |A»|7]|. 

Proof, (i). From Theorem 19.11 we have Xi[l] = 1 — (1 — At) . Thus, we 
have for all i ^ 

^/]<|l_(l_A 4 )'|<l + |l-A^, 

where we used the triangle inequality. 
(ii). We have 



B[l\ > min |1 - (1 - \i) l )\ > 1 - (max |1 - A;|) 

where we used the reverse triangle inequality. 
(Hi). We have 



C[l] < max|l- (1 -Ai) z | < 1 + (max |1 - A* |) 



where we used again the triangle inequality. 
(iv). For all i we have 

P[/]>|l-(l-A t )'|>l-|i "A 4 | Z , 

where we used again the reverse triangle inequality. □ 

One can exploit the neighborhood graph technique further. For in- 
stance, by using similar arguments as in jl] one can obtain estimates 
for^A,) and |9f(A<)|. 
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